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EXECUTIVE  SUMMARY 


Headquarters  Air  Force  Logistics  Command  ( AFLC)  uses  the  Air 
Logistics  Early  Requirements  Technique  (ALERT)  forecasting  model  to 
project  the  Program  Objective  Memorandum  (POM)  outyear  budget  for 
the  Peacetime  Operating  Stock  (POS)  portion  of  the  aircraft 
replenishment  spares  (BP15)  Budget  Estimate  Submission.  The  model 
resides  on  the  Planning,  Programming,  Budgeting  System  (PPBS) 
Subproject  5  analysis  and  forecasting  region  of  the  Requirements 
Data  Bank  (RDB)  computer  system.  Tne  model  is  programmed  in  the 
SAS  statistical  programming  language.  ALERT  can  be  accessed  by  the 
budget  analyst  and/or  BP15  program  manager  through  the  RDB.  This 
user's  guide  gives  the  technical  detail  and  procedures  necessary  to 
run  ALERT. 
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CHAPTER  1 


INTRODUCTION 


In  this  report,  we  will  explain  how  to  run  the  Air  Logistics 
Early  Requirements  Technique  (ALERT)  forecasting  model.  First  we 
describe  the  model.  Then  we  discuss  the  model  inputs  and  how  to 
gather  them.  In  the  final  section,  we  describe  the  actual  steps  in 
running  the  ALERT  model. 


Model  Description 


We  describe  the  ALERT  model  in  the  last  two  year's  ALERT 
forecast  reports  [1]  and  [2].  We  repeat  the  description  of  the 
model  here.  Further  updates  in  the  description  of  the  model  will 
occur  as  we  continue  to  document  the  annual  ALERT  forecasts. 

ALERT  is  a  multivariate  regression  based  model  that  uses 
historical  data  to  predict  future  Program  Objective  Memorandum 
(POM)  requirements  by  weapon  system.  The  model  resides  on  the 
Planning,  Programming,  and  Budgeting  System  (PPBS)  Subproject  5 
analysis  and  forecasting  region  of  the  Requirements  Data  Bank  (RDB) 
computer  system  [3].  The  model  is  programmed  in  the  SAS 
statistical  programming  language.  ALERT  predicts  the  aircraft 
replenishment  spares  (BP15)  Peacetime  Operating  Stock  (POS)  POM 
requirement.  The  model  currently  uses  up  to  eleven  years  of 
historical  data  which  includes  the  following: 

1.  Past  Budget  Estimate  Submissions  for  the  BP15  POS. 

2.  The  sum  of  the  D041  Central  and  Secondary  Item  Stratification 
(CSIS)  extended  year  buy  requirement  plus  the  CSIS  Approved  Force 
Acquisition  objective  (AFAO)  buy  requirement  for  condemnations  only 
(this  is  the  estimate  of  recoverable  buy  requirements  three  to  four 
years  from  the  current  June  computation) . 

3.  The  reciprocal  of  the  present  and  projected  age  of  the  fleet 
(developed  by  USAF/AC) . 

4.  The  dollar  value  of  the  fleet.  This  data  was  developed  in  the 
past  by  USAF/AC.  Current  efforts  are  underway  in  HQ  AFLC/ACC  to 
develop  the  data  in-house. 

ALERT  is  actually  a  five  step  process. 

Step  1  -  Update  the  ALERT  Data  Base  -  In  this  step,  we  collect 
the  most  up-to-date  data  on  each  of  the  variables.  This  includes 
updating  the  D041  Central  and  Secondary  Item  Stratification  (CSIS) 
data  and  the  age  and  value  of  the  fleet  data  and  entering  them  in 
the  data  base. 
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Step  2  -  Develop  Regression  Equations  -  In  this  step,  we  run  the 
ALERT  model  on  the  RDB  computer  which  computes  regression 
equations.  Then  we  select  the  equations  that  result  in  the  best 
fit  of  the  data.  The  criteria  used  to  determine  the  best  fit 
consist  of  the  following  statistical  tests:  the  adjusted  r-square 
(the  coefficient  of  determination),  the  F  statistic,  the  residual 
pattern,  and  the  Durbin-Watson  test.  We  document  these  statistical 
techniques  in  chapter  3. 

Each  weapon  system  has  its  own  regression  equation  and  its  own 
set  of  independent  variables.  We  develop  a  different  set  of 
equations  for  the  POM  forecasts.  We  include  the  output  of  the 
first  set  of  regression  equations  as  historical  data  in  developing 
the  second  set.  (Using  a  regression  forecast  as  another  data  point 
in  developing  yet  another  forecast  is  a  statistical  technique 
called  bootstrapping.) 

Step  3  -  Management  Review  -  The  results  of  step  2  reflect  the 
best  set  of  regression  equations  and  forecasts  based  on  historical 
data.  However,  historical  data  is  not  always  the  best  prediction 
of  the  future.  This  is  because  it  assumes  the  forces  at  work  in 
the  past  will  continue  in  a  predictable  way  into  the  future. 
Therefore,  we  include  a  management  scrub  which  provides  management 
a  chance  to  look  at  the  results  and  identify  any  known  occurrence 
that  would  impact  the  future. 

Step  .  4  -  Develop  New  Regression  Equations  -  we  repeat  step  2 
with  the  data  updated  from  the  management  scrub,  and  we  include 
"dummy"  variables  to  reflect  future  known  occurrences.  For 
example,  if  the  oudget  program  managers  know  of  a  significant 
modification  or  program  change,  we  adjust  the  regression  equation 
to  account  for  the  change. 

Step  5  -  Present  the  at/frt  Forecasts  -  At  this  point,  we  present 
the  ALERT  forecasts  by  weapon  system  and  total  BP15  requirements  to 
the  budget  program  manager. 
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CHAPTER  2 


MODEL  INPUTS 


This  chapter  provides  the  general  information  needed  to  gather 
the  data  for  the  ALERT  BP15  POM  forecasts.  In  it  we  provide  what 
data  is  needed  for  the  ALERT  model,  the  timing  of  the  data 
collection  and  the  time  frame  of  the  forecast  period,  and  how  the 
CSIS  data  is  gathered  from  the  RDB  computer  system. 


Description  of  the  ALERT  Data 


The  data  needed  for  the  ALERT  model  is  as  follows: 

1.  The  latest  BP15  Peacetime  Operating  Stock  (POS)  Budget  Estimate 
Submission  (BES)  numbers.  We  use  the  data  from  the  weapon  system 
summary  tables  as  provided  in  the  annual  BP15  BES.  The  data  is  for 
the  current  year,  the  AY,  BY  and  EY.  We  receive  the  data  not 
earlier  than  1  October  annually.  This  data  represents  the 
dependent  variable  'POSBES'  which  the  ALERT  model  forecasts. 

2.  The  aircraft  fleet  value  numbers.  This  is  the  projected  fleet 
value  from  the  present  through  the  POM  outyears.  Previously, 
UASF/AC  provided  the  data.  The  data  had  to  be  developed  manually 
this  year.  We  have  requested  that  AFLC/ACC  provide  the  numbers  not 
later  than  1  August  annually  for  the  BP15  POM  submission.  This 
data  represents  the  independent  variable  'VALUE'  in  the  ALERT 
model . 

3.  The  fleet  age  numbers.  This  is  the  projected  fleet  age  from 
the  present  through  the  POM  outyears.  Previously,  USAF/AC  provided 
the  data.  We  had  difficulty  getting  the  data  from  Air  Staff  this 
year.  To  ensure  that  the  data  is  made  available  to  us  in  a  timely 
manner,  we  requested  AFLC/ACC  to  secure  this  resource  for  in-house 
(AFLC)  use,  or  to  develop  the  data  in-house.  We  have  requested 
that  we  receive  the  data  not  later  than  1  August  annually.  We  use 
the  reciprocals  of  these  numbers  are  used  in  the  ALERT  data  base. 
This  data  represents  the  independent  variable  'AGEREC'  in  the  ALERT 
model . 

4.  D041  CSIS  data.  We  use  the  restratified  numbers  for  the  30 
June  CSIS  cycle  for  the  ALERT  model.  They  are  considered  more 
accurate  than  the  initial  June  CSIS  products.  This  is  because  file 
maintenance  is  done  on  "the  data  base  between  the  initial  and 
restratified  CSIS  runs.  However,  these  numbers  are  generally  not 
available  until  October/November.  MMMRS  keeps  track  of  when  the 
data  base  is  loaded  on  the  RDB.  Sometimes  the  physical  reports  are 
produced  before  the  June  data  base  is  loaded  on  the  RDB.  However, 
manually  extracting  the  numbers  from  this  report  is  time  consuming 
and  should  be  avoided  if  possible.  We  gather  the  data  from  the  RDB 
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D04 1  budgeting  data  base  from  the  T02  and  T05  reports.  We  describe 
how  to  gather  this  data  from  the  RDB  at  the  end  of  this  chapter. 
This  data  represents  the  independent  variable  '  TBUY '  in  the  ALERT 
model . 

5.  System  Management  Code  (SMC)  data.  A  complete  list  of  SMC 
codes  used  in  last  year's  ALERT  run  is  given  to  the  BP15  budget 
manager  to  review  and  update  in  a  timely  manner  before  the  CSIS 
data  needs  to  be  gathered.  We  have  listed  the  current  SMCs  (the 
ones  used  in  the  1988  ALERT  forecasting  analysis)  in  Appendix  A. 

6.  We  also  maintain  the  following  other  variables  in  the  ALERT 
model  data  base: 

a.  WSYS  -  this  variable  is  not  used  by  ALERT  except  to 

identify  the  data  for  the  particular  weapon  system 
forecasted. 

b.  YEAR  -  (independent  variable)  -  self  explanatory. 

c.  AY  -  (independent  variable)  -  the  apportionment  year 

deficit  from  the  D041  CSIS. 

d.  BY  -  (independent  variable)  -  the  budget  year  deficit 

from  the  D041  CSIS. 

e.  DUMMY  -  (independent  variable)  -  an  inflation  surrogate. 

f.  DUMMY2  -  (independent  variable)  -  a  deflation  surrogate. 

g.  FLTINV  -  (independent  variable)  -  fleet  inventory  -  used  for 

the  B-l  only  as  it  was  being  introduced  to  the 
ALERT  model  data  base. 


Timing  of  the  ALERT  Data 


To  enhance  your  understanding  of  what  value  ALERT  forecasts,  and 
how  the  model's  results  are  applied,  we  present  the  following 
discussion.  The  timing  cycles  for  budget  reporting,  for 
recomputing  a  new  TBUY  value  (described  below) ,  for  reviewing  each 
fiscal  year's  BP15  budget  requirements  estimate  across  the  POM  and 
budget  timeframes,  and  for  the  analysis  steps  (as  discussed  in  the 
Model  Description  part  of  this  report)  all  dramatically  affect  the 
usefulness,  accuracy,  and  currency  of  the  ALERT  results.  For 
instance,  ALERT  was  originally  developed  as  a  POM  forecasting  tool. 
Now,  because  the  budget  timeframe  was  extended  from  one  year  to  two 
years  and  because  the  POM  exercises  are  conducted  every  two  years 
instead  of  annually,  ALERT  also  baselines  the  second  year  of  the 
budget  (See  Figure  2-1) .  ALERT  forecasts  are  annually  updated  to 
be  more  responsive  to  changes  in  the  recoverable  item  CSIS  results 
and  other  changes  to  input  variables  such  as  the  value  of  the  fleet 
or  the  inclusion  of  indicator  variables.  We  hope  to  provide  you  a 
better  appreciation  for  the  timing  dynamics  inherent  in  the  ALERT 
estimation  process  after  you  have  read  this  part  of  the  report. 
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Figure  2-1 

BUDGET  AND  POM  TIMING 


-  SEP  86  ALERT 

—  NO  2 -YEAR  BUDGET 

—  MMMI  USED  SEP  85  ALERT  TO  BASELINE  FY88  BUDGET 
—  MODEL  FORECASTED  FY89-93  POM 

-  SEP  87  ALERT 

—  FIRST  2 -YEAR  BUDGET 

—  MMMI  USED  SEP  86  ALERT  TO  BASELINE  FY90  OF  THE 
FY89/90  BUDGET 

—  MODEL  FORECASTED  FY9Q-94  POM 

-  NO  FY91-95  POM 

-  SEP  88  ALERT 

—  MMMI  USED  SEP  87  ALERT  TO  BASELINE  FY91  OF  THE 
FY89/90  BUDGET 

—  MODEL  FORECASTED  FY92-97  POM 


Budget  Reporting 

In  any  given  year,  a  budget  manager  can  look  over  ten  years' 
worth  of  budget  estimates.  In  addition  to  the  three  years  of 
current  program  year  funds  s/he  is  managing,  s/he  can  also  look  out 
seven  years  from  today  (See  Figure  2-2) .  For  the  purposes  of  this 
example,  we  are  assuming  that  the  present  FY  is  FY88.  The  budget 
manager  is  directly  responsible  for  the  FYs  1988  through  1990.  The 
ALERT  model's  POSBES  does  not  occur  until  four  years  from  the 
present — in  1991.  Then,  ALERT-generated  values  are  also  used  to 
estimate  the  BP15  POSBES  from  1992  to  1997.  The  last  POM  year 
(1997)  is  ten  years  from  the  current  FY. 


Figure  2-2 


BUDGET  MANAGER'S  VIEW  OF  ESTIMATES 


YEAR:  1988  1989  1990  1991 

DATA  MMMIA  HAS  VALUES  ALERT 
FROM:  FROM  BES  AND  AIR  RUN  W/ 
STAFF  TBUY 


1992  1993  1994  1995  1996  1997 

ALERT  RUN  WITH  1991  ALERT  POSBES 
FORECAST  ENTERED  AS  REAL  POSBES 
VALUE 
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Recomputing  a  new  TBUY  value 


The  TBUY  value  is  an  independent  variable  in  the  regression  against 
which  ALERT  forecasts  the  BP15  budget  requirement.  It  is  the  sum 
of  the  CSIS  extended  year  (EY)  buy  requirement  (for  repairs  and 
condemnations)  plus  the  Approved  Force  Acquisition  Objective  ( AFAO ) 
buy  requirement  for  condemnations  only.  Figure  2-3  depicts  where 
the  EY  and  AFAO  time  periods  fall  in  a  look  out  from  today.  The 
CSIS  values  are  used  to  "bootstrap"  the  ALERT  model — and  give  the 
model's  results  more  credibility  because  they  are  based  upon  the 
D04 1  recoverables  computation  (see  Reference  1  for  a  description  of 
bootstrapping) . 
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Analysis  steps 

The  ALERT  analysis  process  typically  begins  in  July  and  ends  in 
December  of  each  calendar  year  (see  Figure  2-4)  .  In  July,  we 
request  updated  data  for  the  age  of  the  fleet  and  the  value  of  the 
fleet,  or  update  it  ourselves.  This  new  data  is  then  appended  or 
overwritten  to  last  year's  ALERT  data  base.  In  August,  the 
previous  year's  ALERT  results  are  presented  to  the  Air  Staff  as  BES 
and  POM  forecasts.  By  September,  the  D041  June  cycle  item  manager 
file  maintenance  and  recoverables  computation  are  completed;  then 
the  recoverables  CSIS  products  and  results  are  produced.  The  ALERT 
model's  TBUY  value  is  developed  from  the  June  final  computation 
cycle  CSIS  results,  generated  in  September.  By  early  October,  all 
the  new  data  has  been  collected  and  entered  in  to  the  ALERT  data 
base.  Within  three  weeks,  after  updating  the  files,  the  ALERT 
forecasts  are  ready  for  input  to  the  next  FY’s  President  Budget. 
ALERT-related  activities  continue  into  November  and  December  with 
briefings  and  reports  documenting  this  year's  results  and  answering 
questions  regarding  the  model  (from  Air  Staff,  auditors,  other 
DCSs ,  etc.)  The  analysis  process  begins  again  in  July  of  the 
subsequent  year. 


Figure  2-4 
ANALYSIS  TIMING 


-  JUNE/JULY 

—  COMPLETE  JUNE  CSIS  IM  REVIEWS  AND  GENERATE  COMP 
—  RECEIVE  MAR  COMP  DATA  TO  USE  IN  DEVELOPING  THE  BES 
—  BEGIN  COLLECTING  OTHER  DATA  INPUTS  (VALUE,  AGE) 

-  AUG/SEP 

—  IF  A  'POM'  YEAR,  USE  LAST  YEAR'S  ALERT  TO 

PROVISIONALLY  PRESENT  POM  ESTIMATES  TO  AIR  STAFF 
—  UPDATE  DATA  BASE  WITH  'YEAR',  'VALUE',  'AGE' 

VALUES 

-  OCT 

—  EACH  YEAR,  RUN  ALERT  TO  BASELINE  THE  2ND  BUDGET 
YEAR 

—  USE  SEP  COMP  DATA  TO  DEVELOP  'TBUY'  VALUE 
—  PREPARE  RESULTS 


Review  of  the  BP15  Budget  Requirements  Estimate 

Specifically,  we  will  address  how  many  times  a  given  fiscal 
year's  BP15  POS  budget  requirement  estimate  is  formally  reviewed 
and  presented  for  Air  Staff  approval  (see  Figure  2-5) .  For 
example,  the  first  time  a  BP15  POS  budget  requirement  estimate 
(forecast)  is  presented  is  in  the  FY89  POM  submission.  The  ALERT 
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model  will  estimate  the  POSBES  number  for  FY96.  The  next  time  the 
BP15  FY96  POS  budget  requirement  forecast  is  formally  reviewed  is 
in  the  FY90  POM  ,  the  third  time  will  be  in  the  FY91  POM,  and  the 
fourth  time  will  be  in  the  FY92  POM.  In  between  these  POM  cycles, 
the  estimates  will  be  reported  in  the  President’s  Budget  reports, 
but  the  numbers  will  NOT  be  re-estimated.  All  of  these  bottom-line 
POM  forecasts  will  be  developed  using  the  ALERT  model.  The  first 
FY96  BES  for  BP15  will  be  in  FY94.  This  “second  year  budget" 
estimate  is  baselined  from  the  ALERT  model's  forecast,  but  the 
estimate  is  subject  to  a  management  scrub.  The  second  FY96  BES 
will  be  in  FY95  and  is  developed  from  the  D041  CSIS  results  and 
management  judgment.  The  actual  budget  execution,  or  spending  of 
the  FY96  BP15  budget  will  begin  in  FY96. 


Figure  2-5 

HOW  OFTEN  IS  A  FISCAL  YEAR  EXAMINED? 
EXAMPLE:  FY96 

-  FIRST  POM  LOOK  IS  IN  FY89 

-  SECOND  POM  LOOK  WILL  BE  IN  FY90 

-  THIRD  POM  LOOK  WILL  BE  IN  FY91 

-  FOURTH  POM  LOOK  WILL  BE  IN  FY92 

-  1ST  BUDGET  LOOK  WILL  BE  IN  FY94 

-  2ND  BUDGET  LOOK  WILL  BE  IN  FY95 

-  ACTUAL  BUDGET  EXECUTION  WILL  BE  IN  FY96 
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Gathering  CSIS  Data  from  the  RDB 


As  your  initial  starting  point,  we  assumed  that  you,  the  ALERT 
model  user,  will  be  accessing  the  RDB  computer  system  through  the 
Local  Area  Network  (LAN).  Using  a  Z-248,  you  can  access  the  LAN  by 
using  your  CALL  program.  At  the  LAN  prompt,  type  "connect  rdb"  and 
the  <return>  key.  Your  screen  should  appear  as  follows: 

You  may  now  enter  Net/One  commands. 

» 

»  < -  This  is  a  LAN  prompt. 

» 

»connect  rdb 

Connecting  ...  (3)  407720A2  Success. 

Now  hit  the  <return>  key.  This  should  bring  up  the  prompt  for  the 
terminal  type.  Enter  "rdbz248"  and  <return>. 

ENTER  TERMINAL  TYPE:  rdbz248 

This  should  bring  up  the  RDE  access  screen.  Type  "rdb"  and 
<return>  at  the  cursor  as  shown  below: 

ENTER  APPLICATION  REQUEST 


RRRRRRRRRR 

DDDDDDDDD 

RR 

RR 

DD 

DD 

RR 

RR 

DD 

DD 

RRRRRRRRRR 

DD 

DD 

RR 

RR 

DD 

DD 

RR 

RR 

DD 

DD 

RR 

RR 

DDDDDDDDD 

BBBBBBB 
BB  BB 

BB  BB 

BBBBBBBB 
BB  BB 

BB  BB 

BBBBBBB 


This  should  bring  up  the  ROB  user-id  screen.  Enter  your  user-id 
and  password:  type  "user- id"  <tab>  and  "password"  <return>.  This 
is  shown  below: 


WELCOME  TO  THE 

REQUIREMENTS  DATA  BANK  SYSTEM  ! 

PLEASE  ENTER  YOUR  USERID  AND  PASSWORD. 

USER-ID:  user-id 
PASSWORD:  password 


This  will  bring  up  the  current  system  news  screen.  Enter  <return> 
to  bring  up  the  main  menu.  You  should  see  the  following  screen: 


REQUIREMENTS  DATA  BANK  MAIN  MENU 

1.  HELP  -  THE  RDB  HELP  SYSTEM 

2.  NEWS  -  GENERAL  NEWS,  AND  INFORMATION 

3.  ELECTRONIC  MAIL  -  SEND  OR  RECEIVE  MAIL 

4.  DISCREPANCY  REPORT  STATUS 


APPLICATION  AREA: 

6.  EOQ  DEPOT  DATA  BANK 

7.  EOQ  CSIS 

8.  RECOVERABLE  ITEMS 

9.  EQUIPMENT  ITEMS 


(D062DDB) 
(D062  CSIS) 
(D041) 
(D039) 


SYSTEM  MANAGEMENT: 

20.  PROGRAM  DATA  (K004/G033J) 

21.  FINANCIAL  SYSTEMS 

22.  RETAIL  STOCK  FUND  (D141A/B) 


ENTER  SELECTION:  XX 
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At  the  "XX"  you  should  enter  "8"  or  "08"  for  recoverable  items. 
This  will  bring  up  the  following  screen: 


REQUIREMENTS  DATA  BANK 
MAIN  MENU  FOR  D041  CSIS 

TYPE  'X'  NEXT  TO  THE  DESIRED  SELECTION 

DIS  DISPLAY 

_  DQ  DATA  QUERY 

JS  JOB  SUBMISSION 


CMD: 


F1=HELP  F10=DONE  MSG: 


Enter  an  "X"  at  DIS  DISPLAY  and  <return>  or  you  can  type  "DIS"  next 
to  CMD:  on  the  bottom  line  of  the  screen  and  <return>.  This  will 
bring  up  the  following  menu: 


DISPLAY 
DIS  DISPLAY 

TYPE  'X*  NEXT  TO  THE  DESIRED  SELECTION 
_  ACO  CURRENT  ASSET  CUTOFF  DATE 
_  BUD  BUDGET  PRODUCTS 
_  RPR  REPAIR  PRODUCTS 

CMD:  Fl-HELP  F10=DONE  MSG: 
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If  you  want  to  see  the  dates  of  the  latest  data  bases  loaded  for 
the  D041  CSIS ,  type  an  "X"  next  to  ACO  and  <return>.  To  return  to 
the  DISPLAY  menu  type  <Esc>  "0"  (which  corresponds  to  the 
' F10=DONE ' )  or  enter  "done"  at  the  ' CMD : '  line  and  <return>.  Now 
enter  an  "X"  next  to  BUD  and  <return>.  This  will  bring  up  the 
following  menu: 


DISPLAY 

BUD  BUDGET  PRODUCTS 
TYPE  'X'  NEXT  TO  THE  DESIRED  SELECTION 


SOI 

BUDGET  ITEM  DETAIL 

T07 

BP  INS/NSO 

S04 

BP 

T08 

BP  NEW 

S05 

DIV  BP 

T12 

BP  MMC/FSC 

S06 

DIV  IMS  BP  SMC 

T13 

TOTAL  ITEMS 

S07 

BP  SMC 

T14 

TOTAL  BUY 

S08 

DIV  BP  SMC 

T15 

TOTAL  INS/NSO 

T01 

MMC/FSC 

T16 

TOTAL  NEW 

T02 

BP  SMC 

T20 

DIV  IMS  BP 

T03 

BP  SMC  BUY 

T21 

DIV  BP  SMC  MMC/FSC 

T04 

BP  SMC  NEW 

T22 

DIV  BP  SMC 

T05 

BP 

'  T23 

DIV  BP 

T06 

BP  BUY 

T24 

DIV  TOTAL 

CMD:  F1=HELP  F10=DONE  MSG: 


Enter  an  "X"  next  to  the  T02  and  <return>.  The  T02  report  gives 
the  necessary  CSIS  data  by  budget  program  (BP)  and  system 
management  code  (SMC) .  Enter  a  <tab>  to  bring  up  the  screen  below 
and  fill  in  the  necessary  information.  The  screen  should  appear  as 
follows: 


PCN :  A  D041.-T02  CENTRAL  SECONDARY  ITEM  STRATIFICATION  PROD  RECS4160 
PAGE:  1  OF  1  BUDGET  SUMMARY  CUR  DT/TIME:  30  NOV  88  07:48 

_ -MM  POSITION-QP  FUNDING-FULL  PR ICE -FORE CAS TED  AS  OF  DT:  30  JUN  88 

BP- _  SMC- _ 

- (DOLLARS  IN  THOUSANDS) - 


CMD:  F1=HELP  F10=DONE  MSG: 
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The  previous  screen  is  not  aligned  compared  to  the  compressed 
computer  screen,  but  all  the  information  should  be  correct.  You 
will  need  to  be  sure  that  all  the  underlined  areas  are  correct. 
Tabbing  will  move  you  from  underlined  area  to  underlined  area.  If 
you  make  a  mistake  or  miss  an  underlined  area,  keep  tabbing  until 
you  return  to  the  desired  position.  The  following  underlined  areas 
must  be  filled  in: 

_ -MM  Enter  "HQ"  (Other  selections  are  "OC," 

"00,"  " S A , "  "SM, "  and  "WR") 

POSITION-OP  Enter  "AY,”  "BY,"  or  "EY" 

FUNDING-FULL  Leave  alone 

PRICE-FORECASTED  Leave  alone 

AS  OF  DT:30  JUN  88  Should  be  JUN  or  appropriate  cut  off  date 

BP- _  Enter  "15" 

SMC- _  Enter  appropriate  four  letter  code 


After  you  have  entered  all  the  appropriate  information,  enter 
<return>  for  the  computer  to  call  the  information  to  the  screen. 
For  each  SMC  in  BP15,  you  will  need: 

in  AY:  Total  apportionment  year  deficit  (row  13,  column  9) 
in  BY:  Total  budget  year  deficit  (row  13,  column  9) 
in  EY:  Total  extended  year  deficit  plus  on-order  commit  plus 
on-order  contract  (row  13,  columns  7,  8  and  9) 

When  you  are  finished  gathering  data,  enter  <Esc>  and  "0."  This 
will  return  you  to  the  DISPLAY  menu.  Select  the  T05  report  and 

gather  the  data  as  you  did  from  the  T02  report.  Note  the  'SMC- _ ' 

line  is  missing.  The  T05  data  gives  you  the  summation  of  CSIS  data 
across  all  SMCs  for  the  BP.  The  total  T05  data  minus  the  total  of 
the  T02  data  yields  the  CSIS  data  for  the  'other'  weapon  systems  we 
forecast. 


When  you  are  finished  gathering  data,  enter  <Esc>  and  "0"  until  you 
return  to  the  RDB  screen. 
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CHAPTER  3 


RUNNING  THE  ALERT  MODEL 


This  chapter  contains  the  procedures  for  running  the  ALERT  BP15 
POM  forecasting  model  on  the  Requirements  Data  Bank's  Subproject  5 
analysis  and  forecasting  region.  We  present  our  assumptions  made 
for  these  procedures  and  then  present  them  in  a  step  by  step 
fashion. 


Assumptions 


We  make  the  following  assumptions  about  the  user  running  the 
ALERT  model. 

1.  It  is  assumed  that  the  user  has  a  working  knowledge  of  the 
ROSCOE  on-line  program  development  system.  The  user  should  know 
how  to  save,  retrieve,  and  edit  program  data  sets  using  ROSCOE. 

2.  It  is  assumed  that  the  user  has  an  RDB  ROSCOE  user- id  and 
password.  If  they  do  not,  a  user-id  and  password  can  be  obtained 
from  HQ  AFLC/MMISA. 

3.  It  is  assumed  that  the  user  has  a  fundamental  understanding  of 
the  multivariate  regression  and  bootstrapping  techniques  used  in 
ALERT. 

4.  It  is  assumed  that  the  user  has  a  statistical  background  from 
which  he  can  interpret  the  results  of  the  model. 

5.  It  is  assumed  that  the  user  has  gathered  the  necpssary  data  to 
update  the  data  bases  used  in  ALERT. 

6.  A  working  knowledge  of  the  SAS  programming  language  would  be 
appropriate  but  not  totally  necessary  for  running  the  model. 


Procedures 


Running  the  ALERT  forecasting  model  involves  the  updating  and 
running  of  seven  different  programs.  We  list  the  programs  in  the 
Table  3-1. 


ALERT  PROGRAM  NAMES 


PROGRAM  NAME  DESCRIPTION 


RLA. ALERTDB 

UPDATES  ALERT  DATA 

BASE 

RLA. ALERT 1 A 

ALERT 

MODEL 

PART 

1 

-  STEP 

A 

RLA. ALERT IB 

ALERT 

MODEL 

PART 

1 

-  STEP 

B 

RLA. ALERT 1C 

ALERT 

MODEL 

PART 

1 

-  STEP 

C 

RLA . ALERT2 A 

ALERT 

MODEL 

PART 

2 

-  STEP 

A 

RLA. ALERT2B 

ALERT 

MODEL 

PART 

2 

-  STEP 

B 

RLA. ALERT2C 

ALERT 

MODEL 

PART 

2 

-  STEP 

C 

Table  1 


The  RLA . ALERTDB  program  is  used  to  update  the  ALERT'S  data  bases. 
RLA . ALERT 1 A ,  RLA. ALERT1B,  and  RLA. ALERT1C  are  used  in  the  initial 
bootstrapping  run  of  the  ALERT  model.  RLA . ALERT2 A ,  RLA. ALERT2B, 
and  RLA . ALERT2 C  are  used  to  make  the  ALERT  projections  for  the  POM 
outyears.  The  following  steps  describe  how  to  run  the  ALERT 
forecasting  model. 


Step  1  -  Getting  onto  the  ROSCOE  on-line  program  development  system 
on  the  RDB. 

As  your  initial  starting  point,  we  assumed  that  you,  the 
prestigious  ALERT  model  user,  will  be  accessing  the  RDB  computer 
system  through  the  Local  Area  Network  (LAN).  Using  your  Z-248,  you 
can  access  the  LAN  by  using  your  CALL  program.  At  the  LAN  prompt, 
type  "connect  rdb"  and  the  hit  the  <retum>  key.  Your  screen 
should  appear  as  follows: 

You  may  now  enter  Net/One  commands. 

» 

»  < -  This  is  a  LAN  prompt. 

» 

»connect  rdb 

Connecting  ...  (3)  407720A2  Success. 

Now  hit  the  <return>  key.  This  should  bring  up  the  prompt  for  the 
terminal  type.  Enter  "rdbz248"  and  <retura>. 

ENTER  TERMINAL  TYPE:  rdbz248 
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This  should  bring  up  the  RDB  access  screen.  Type  "roscoe"  and 
<return>  at  the  cursor  as  shown  below: 

ENTER  APPLICATION  REQUEST 
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BB  BB 

BB  BB 

BBBBBBBB 
BB  BB 

BB  BB 

BBBBBBB 


toscoe 


This  should  bring  up  the  ROSCOE  access  screen.  Enter  your  user-id 
and  password:  type  "user- id"  <tab>  and  "password"  <return>.  This 
is  shown  below: 


KEY  user-id 
PASSWORD  password 

This  will  bring  up  a  compressed  font  version  of  the  Active  Work 
Space  (AWS)  screen.  To  return  the  AWS  screen  to  a  normal  width, 
enter  "mod  2"  and  <return>. 


Step  2  -  Updating  the  ALERT  data  bases. 

The  top  of  your  computer  screen  should  now  appear  as  follows: 


(These  top  three  blank  lines  are  the  command  section  of  the 
screen. ) 

> 

>  AWS ( )  SCRL  FULL  COLS  00001  00072  PAU(  .SYNON) 

> 

<...  +  ....1.. ..  +  ... .2. ..3. ...  +  .. ..4. ...  +  .. ..5. ...  +  .. ..6. ...  +  .. 


Fetch  the  program  RLA . ALERTDB  to  your  AWS.  Enter  "fetch 
rla.alertdb  &  attach"  and  <return>  in  the  command  section  of  your 
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screen.  If  you  are  using  the  'ppbSrla'  user- id,  you  will  not  need 
to  enter  the  prefix  "rla."  Your  screen  should  now  appear  as 
follows: 


> 


>  AWS ( RLA . ALERTDB )  SCRL  FULL  COLS  00001  00072  PAU  (  .SYNON) 

> 

<...  + _ 1 _ + _ 2 _ + _ 3 _ + _ 4 _ + _ 5 - + - 6 - + 


000100 

000200 

000300 

000400 

000500 

000600 

000700 

000800 

000900 


//PPB5RLA2  JOB  (00000 ,  LCA)  BIN84  LUCAS  75249', 

//  CLASS=A,MSGCLASS=X,N0TIFY=R0S1RLA 
//SAS  EXEC  PROC=SAS , W0RK= '50,10' 

//ALERTDB  DD  DSN=PPB5GRP. ALERT. JUN88 , DISP= (OLD, CATLG, KEEP) , 
//  UNIT=PPB5 , SPACE= (CYL, (30,30) , RLSE) 

//SYSPRINT  DD  SYSOUT=* 


/***********************************/ 
/*  PROGRAM:  ALERTDB  */ 


The  bold  printing  needs  to  be  updated.  The  'RLA'  in  'PPB5RLA2'  and 
'ROS1RLA '  should  be  the  last  three  letters  of  your  user-id.  The 
'2'  in  ' PPB5RLA2 '  can  be  any  number  or  letter  of  your  choice.  The 
'  PPB5RLA2 '  is  the  job  identification  number.  After  you  have 
submitted  the  program,  the  'R0S1RLA '  notifies  you  when  your  job  is 
finished.  The  'BIN84  LUCAS  75249'  is  for  further  identification  of 
your  job.  'BIN84'  identifies  the  bin  the  job  should  be  routed  to 

when  it  is  completed.  The  other  two  are  your  name  and  phone 
extension.  The  ' PPB5GRP. ALERT. JUN88 '  identifies  the  SAS  data  set 
that  the  SAS  programming  language  is  to  create  when  the  job  is  run. 


The  ' JUN88 '  identifies  this  data  base  as  being  updated  with  June 
1988  data.  Enter  an  appropriate  string  to  replace  'JUN88, '  i.e., 
'  JUN89 .  ' 
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After  you  have  completed  these  initial  efforts,  you  will  want  to 
update  the  data  base  in  the  RLA . ALERTDB  program.  On  the  following 
page  is  an  example  of  the  FY88  A-7  aircraft  data.  We  added  the 
column  markings  above  the  data  for  clarity. 


A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

003700 

CARDS 

• 

/ 

003800 

A7 

78 

14269 

7342 

53001 

7.0 

1958 

.17 

0 

0 

003900 

• 

A7 

79  . 

« 

• 

004800 

A7 

88 

16180 

15753 

415200 

14.2 

3431 

.069 

0 

0 

004900 

A7 

89 

3102 

24050 

66678 

9.6 

3522 

.070 

0 

0 

005000 

A7 

90 

7207 

8646 

166060 

15.7 

3585 

.  065 

0 

0 

005100 

• 

A7 

91  . 

• 

• 

005600 

A7 

96 

0 

0 

0 

1442 

.047 

0 

0 

005700 

005800 

A7 

•  •  • 

97 

•  •  •  • 

0 

0 

0 

— 

1477 

.045 

0 

0 

If  we  were  updating  this  June  1988  data  base  for  the  FY89  ALERT  POM 
run,  we  would  not  modify  any  of  the  history  data  (anything  up  to 
and  including  1988) .  We  would  only  modify  those  data  lines  from 
1989  on.  In  addition,  we  would  also  add  a  line  of  data  for  the 
last  POM  outyear,  FY98. 

The  definitions  for  the  columns  of  data  are: 


Column  A 
Column  B 
Column  C 
Column  D 
Column  E 
Column  F 

Column  G 
Column  H 
Column  I 
Column  J 
Column  K 
Column  L 


the  program  line  numbers 

weapon  system 

year 

AY  deficit 
BY  deficit 

EY  total  CSIS  buy  (on-order  contract,  commit,  and 
deficit) 

BP15  POS  BES 
fleet  value 
fleet  age  reciprocal 
inflation  surrogate 
deflation  surrogate 
fleet  inventory 


When  you  have  completed  updating  the  data  bases,  you  will  need  to 
save  this  updated  program  for  future  use  and/or  reference.  If  you 
are  using  the  'ppbSrla'  user-id,  you  will  enter  "update  *"  (or  the 
asterisk  can  be  the  name  of  the  user  file:  alertdb)  .  If  you  are 
using  a  different  user-id  you  will  want  to  save  the  file  under  your 
own  user- id.  The  first  tire  you  save  it  you  will  enter  "save 
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alertdb"  (or  some  other  unique  file  name.  We  recommend,  however, 
that  for  consistency  yuu  should  use  the  same  file  names  that  are 
used  in  this  report) .  Vou  do  not  need  to  add  the  prefix,  as  ROSCOE 
will  automatically  put  the  last  three  letters/numbers  of  your  user- 
id  as  a  prefix  to  the  file  you  are  saving.  After  the  file  has  been 
saved  for  the  first  time,  you  can  update  the  existing  file  by 
entering  "update  alertdb." 

Now  submit  this  program  to  the  job  stream.  Enter  "sub"  and 
<return>  in  the  command  section  of  the  screen.  Enter  "dis  ppb*"  to 
get  an  update  of  the  job  status;  or  you  may  periodically  hit  your 
return  key  and  look  for  the  computer's  notification  of  the  job's 
completion. 

When  the  job  run  is  completed,  attach  the  job  for  viewing  on  your 
PC  computer  screen.  Enter  "attach  job  ppb5rl*2"  and  <return>.  The 
first  of  five  job  output  files  will  be  attached  to  your  screen. 
You  may  view  each  of  the  files  by  entering  "prev  file"  and  <return> 
or  "next  file"  and  <return>. 

To  print  the  job  files,  while  the  job  is  still  attached,  enter 
"status"  and  <return>.  Something  similar  to  the  following  screen 
will  appear: 


> 

>  STA ( PPB5RLA2 , # # # # )  SCRL  FULL  COLS  00001  00072  PAU (  .SYNON) 

> 


< _ + _ 1 - + _ 2....  + _ 3 - + _ 4 _ + _ 5 _ + _ 6 _ + 

ROSCOE  ALTER/STATUS  PROCESSOR 


JOB 

NAME 

NO 

FILE 

LINE 

PAGE/ 

LINE  FIND  LIMIT  I/O 

PPB5RLA2 

2238 

4 

1 

1 

1  6000 

(1) 

(2) 

(3) 

(4) 

(5) 

A 

FILE 

STA  C 

DEST 

LINES 

FORM 

CPY 

NOTES 

1 

NOP  X 

LOCAL 

17 

STD 

1 

JES2 . $JES2LOG 

2 

NOP  X 

LOCAL 

43 

STD 

1 

JES2 . $JCLIMG 

3 

NOP  X 

LOCAL 

98 

STD 

1 

JES2 . $SYSMSGS 

4 

NOP  X 

LOCAL 

364 

STD 

1 

STATS . SAS . FTllFOm 

5 

NOP  X 

LOCAL 

1784 

STD 

1 

STATS. SAS. FT1*.  \ 

===========================  END  OF  OUTPUT  FILES  ========== 


The  first  three  files  are  JCL  files.  The  fourth  is  the  program's 
SAS  source  code,  and  the  fifth  is  the  program  output.  You  will 
probably  only  want  the  fourth  and  fifth  files.  In  column  (1), 
enter  a  "P"  (for  "Print") *  next  to  FILE  lines  4  and  5.  Then  detach 
the  job  by  entering  "detach  job"  at  the  top  of  the  screen  and 
<return>.  The  listings  will  print  out  in  the  computer  room  in  the 
basement  of  the  building  and  will  be  routed  to  your  program 
listings  pickup  bin.  If  you  want  to  print  the  program  out  at  the 
AFLC/MMM  Lee  printer,  you  may  enter  the  following  code  under  column 
(3)  on  the  last  two  lines:  "U721  "  to  print  on  the  Lee  printer  at 


20 


post  106R. 


If  for  some  reason  you  make  an  error  in  the  ALERT  data  base  (i.e., 
loading  bad  data) ,  you  can  correct  this  in  the  following  manner. 
First  load  the  RLA.ALERTDB  file  into  your  AWS  space  and  make  the 
necessary  corrections  to  the  file.  Then  you  can  rerun  the  program 
which  will  recreate  your  data  base. 

You  are  now  ready  for  your  first  bootstrap  run  of  the  ALERT  model. 
Step  3  -  First  part  of  the  ALERT  model  run  -  Step  A. 

The  first  part  of  the  ALERT  model  run  is  to  select  the  last  POS  BES 
value  before  the  POM  outyears.  Step  A  computes  all  the  possible  R- 
square  values  for  all  combinations  of  the  regression  variables. 
From  these  you  will  select  a  "library"  of  possible  regression 
equations  to  model  in  step  4.  The  main  SAS  procedure  executed  for 
each  weapon  system  is  as  follows: 


PROC  RSQUARE  CP; 

MODEL  POSBES  =  TBUY  DUMMY  DUMMY 2  VALUE  YEAR  AGEREC; 


Fetch  the  first  ALERT  model,  RLA . ALERT1 A ,  to  your  AWS  computer 
space.  Your  computer  screen  should  appear  as  follows: 


>  AWS ( RLA . ALERT 1 A )  SCRL  FULL  COLS  00001  00072  PAU(  .SYNON) 

> 

<...+....1.. ..+... .2. ...+.. ..3. ...+.. ..4. ...+.. ..5. ...+.. ..6... 

000100  //PPB5RLA2  JOB  ( 00000  ,  LCA)  BIN84  LUCAS  75249', 

000200  //  CLASS=A,MSGCLASS=X,N0TIFY=R0S1RLA 

000300  //STATS  EXEC  PR0C=SAS , WORK= ' 50 , 10 ' 

000400  //ALERTDB  DD  DSN=PPB5GRP. ALERT. JUN88, DISP=SHR 
000500  //SYSPRINT  DD  SYS0UT=* 

000600 


000700 

/****************************************/ 

000800 

/* 

V 

000900 

/* 

FIRST  ALERT  PROGRAM 

*/ 

000000 

/* 

STEP  A 

*/ 

001100 

/* 

( ALERT 1A) 

*/ 

001200 

/* 

*/ 

001300 

/****************************************/ 

You  will  need  to  update  the  bold  characters  as  you  did  in  step  2. 
No  further  modifications  are  necessary  unless  you  are  adding  or 
deleting  weapon  systems  from  the  ALERT  model  runs. 
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Submit  this  program  to  the  job  stream  as  you  did  in  step  2. 

On  the  following  two  pages  is  the  output  for  RLA . ALERT  1 A ,  Step  A 
for  FY88.  Your  objective  is  to  select  the  models  that  have  a  high 
R-square  and  a  C(P)  value  that  approaches  the  number  of  variables 
in  the  model.  For  each  type  of  model  (i.e.,  one  variable,  two 
variables,  three  variables,  etc.),  there  appears  to  be  a  natural 
break  where  the  R-square  and  C(P)  values  suddenly  change  and  get 
worse.  These  natural  breaks  are  indicated  by  the  straight  lines 
that  we've  drawn.  Note  that  R-square  is  the  coefficient  of 
determination  and  C(P)  is  Mallow's  Cp  statistic.  R-square  is 
interpreted  as  being  the  percentage  of  the  total  variation  in  the 
dependent  variable  that  can  be  explained  by  the  model  (regression 
equation)  [4].  For  Mallow's  statistic,  when  the  right  model  is 
chosen,  the  parameter  estimates  are  unbiased,  and  this  is  reflected 
in  Cp  being  near  to  the  number  of  variables  in  the  model  [5]. 

Those  models  below  the  lines  are  candidates  for  input  in  Step  B 
(Step  4)  .  We  further  narrowed  the  possible  models  to  those 
indicated  by  the  asterisks  (*).  Since  the  A-7  data  base  has 
nothing  but  zeros  for  the  DUMMY 2  variable,  this  variable  is 
meaningless  in  the  regression  equations.  Therefore,  we  eliminated 
all  models  that  have  this  variable  in  it.  Also,  no  regression 
equations  can  be  dependent  on  the  variables  DUMMY  and/or  DUMMY 2 
alone.  Therefore,  we  eliminated  all  such  type  models.  The  models 
with  the  asterisks  are  the  ones  that  become  the  input  to  the  next 
step. 


22 


N  = 1 3  K  t  LKL  b S 1 UN  MOUELS  POK  OEPENUEM  VARIABLE:  PObBES  MODEL :  MODEL  1 


E  * 

^  itt 


y 

i  r. 

U)  -1 

/=.  1 

%  \li 

'*  D 

U.I  -3 


(U  O 


o 

'UUIO 

X  3  UJ  1  N  vj  < 

-U-4a£<>  UJ  UJ  X  < 
O  <  UJ  UJ  X  Qt  3  <  : 

<  >  3  >■  X  X  -J  UJ  UJ  I 

<  3 

rsl  j  'NJ  *Nl  N  □  >  >  < 

V  UJ  UJ  >»  1  >  ^  UJ  >  Ul 

i  ^  3  i)-i  »  xxox>->->->-3< 
x  a  -j  -*  o  x  i  xx-ix3333«i 

3  I  33<D3-33at 

3  <  ^  m-  Q  | 


4  fN.  f>*  <7* 
*N  <7*  <3  4  <*N 


%»  O  O  "NJ  4-|rM  | 


a  ®  a  -*N  a  4  | 
^  C7*  <>  <7*  a  -*  I 


O^'O  B-3N  | 
0®5>-*0N  1 
O  4  O  >  4  a  I 

O  "N  a  ^  IT*  U\  I 

o  o  *\j  o  un  u\  i 

O  O  M  ^  ♦  I 

o  o  o  4  a  a  i 

o  o  o  o  o  ^  i 


0* 

o  o 

r* 

CT» 

a 

'NJ 

UN 

rs 

m 

UN  'NJ 

a 

1 

o 

a 

'NJ 

UN 

a  rw 

a 

-o 

a  un 

a 

a 

a  ^ 

4* 

fNJ 

•t 

4^ 

i 

a 

a 

a 

UN 

—4 

a 

un 

•NJ 

o 

4- 

*N 

-*N 

-NJ 

4* 

4- 

— < 

>  UN 

4- 

UN 

O 

1 

o 

*N 

'NJ 

4* 

UN 

4* 

__i 

UN 

*VJ 

UN 

4* 

UN 

*N  O 

rs. 

4* 

'NJ 

a 

i 

UN 

—4 

UN 

'NJ 

> 

f*N 

4- 

n 

> 

rs. 

UN 

JN 

4* 

a 

^  o 

*o 

•NJ 

1 

HN 

UN 

’T' 

UN 

a 

a 

> 

o 

UN  ^J 

rs 

■"N 

a 

•r 

i 

a 

3* 

3» 

o 

UN 

• 

• 

a* 

•NJ 

4* 

O 

•NJ 

3* 

-r  o 

<nu  3 

— < 

1 

O* 

a 

'NJ 

9* 

a  4* 

a 

o 

o 

a 

o 

">  O' 

•NJ 

a 

rs 

'NJ 

i 

a 

a  o 

a 

■n 

^N 

O 

o 

4- 

> 

> 

'NJ 

UN 

r. 

*n 

UN  fN 

o 

-o 

o 

1 

4* 

'NJ 

UN 

UN 

rs. 

UN 

-n 

41 

a 

fNJ 

o 

a 

■0  3 

—4 

o 

O 

a 

rs 

i 

UN 

UN 

4* 

a 

a 

O 

o 

r*. 

a 

o 

m 

rs 

«r 

rs. 

•M  — t 

o 

O 

1 

f% 

O  *N 

a 

*r 

a 

-O'? 

—4 

o 

r* 

a 

UN 

o 

a 

rs 

a 

i 

a 

a  un 

w 

Cr 

o 

r* 

UN 

o 

o 

> 

-u 

a  a 

a 

UN 

UN 

1 

3^ 

rs. 

■n 

UN 

- 

a 

a 

o.  r>* 

rs 

rs 

4- 

a 

•*> 

i 

> 

r>s 

-N 

4* 

*n 

•> 

■n  O  a**  a  a  ■ruN'>j'>0''-Q*'J40 
-do»~n-«ooj'0  a  o  ^j  o  "■»  <v  a 
4-  3  O  >  N  -H  \  31  O  ^  a  ■•"»  J* 

*n  o  a  rt  j>  o  fl->A*in>'t)7*o 

o  N  MJ  o  >A  «f  O  N  ^  O  >A  3  13  -*  O 

o  AJ  /\  >  ?>  0'A'D7N>f^r>3J‘ 
O  O  NJ  j-  3  CT  O  -»  0  ^  0  .0  a  3  3 
000000^*^'NJ4*»A*'.fN.psrw 


I  X  X  M 
:  <  uj  cc 
l  iJ  J  OJ 

>  >-  <  o 
:  «x 

JJ  UJ 

031 


>»>->» 

:  >  >  i  t  t 
33111 

►  3  3  3  3  3 

►  r-  *-  3  3  3 

-S'*-*** 


a  »n  3  i/un  r  • 


:A'Njo»^3>O^NON«r-<  a  rs  • 
?00flV0'><»0^%»'<0'ni 
N^>*jN?AiAN8nN3'0' 
O  -  A  A  3  3  AA^3J>AD3: 

■na',*>>j^no/j'o'35*o 

O  3  3  3  3A 

-*  — *  — 4  “vj  -'N  ^  4*  UN  **»  ^  rs  r»  rs  « 


o  o 

UJ  LU  o  -U 

i  i  i  ij  u  J 

JJ  <  UJ  2  JJ  J 

■J  JJ  3  JJ  2  < 

<>  <  J  OJ  > 

<  3 

UJ  'XI  X  <  -M 

3  3  «X  X  >• 

_l  J  JJ  <  2  £ 

<  <  >-  OJ  <t  X. 

>  >  >  UJ  3 

UJ  >-  3 

*NJ  “NJ  3  “U 

>  >-  «J  >-  UJ  >* 

r  r  <  t  3  s 

£  X  >  X  J  £ 

3  3  3  <  3 

3  Q  Al  Q  >  3 

>- 

>>!>>> 
3  3X333 
3  a  3  13  -3  3 

H-  »-  3  r-  —  i* 


=0  0  UN  4  4  -* 


3*  -  NJ  O  -- 

O  <NJ  ^  3^  — 

O  fNJ  UN  UN  “NJ  NJ 

A  3  A  A  3  UN 

'**  4  a  -*  :*  4 

rs  rj  a  3  *u  a 

an  4-  *•  o  a  a 

h  n  Tin  un  ~ 


0  3  0  0  O  O  I  oooooooooof 


I  “vJ  'NJ  'NJ  'NJ  "NJ  *NJ  Nj  fNJ  %J  *NJ  r 


OOODOOCOlOOOOOO' 


O  C  O  O  3  0 


rna'-n^-Naa-n 


23 


lb:  11  rftDNfcSDAV.  NOVfcttbfcK  lb»  19UB 


X 

< 


o 

3 

o  LU 

O 

< 

3  X  X 

0  3  3 

X  X  <  3 

3X30 

1  X 

«X  3  XJ  X  O 

X  3  X  3 

1  < 

OJ  J  >  <  < 

UJ  O  XJ  X 

1  3 

V  <  3 

j  <  3  3 

1  > 

3 

XJ  >  XJ 

<  <3 

1 

XI 

M  <M  3  3 

X  < 

1  3 

3 

>>■333 

3  <  X 

1  3 

□ 

X  X  <  3  < 

3  3  <  X 

1  3 

LU 

X 

X  X  >  3  > 

O  >  3  < 

1  < 

3  3  < 

<  >3 

1  > 

j 

2 

O  O  ?m  >  -u 

>  M  > 

1 

>  > 

>  3 

1 

2 

>  >  X  >  X 

>  X  3  > 

|  > 

x 

•J% 

X  x  X  x  X 

X  X  O  X 

1  X 

U 

•XJ 

X  X  3  X  3 

X  3  <  X 

1  X 

XI  »— ■ 

3 

3  3  0  3  3 

3  3  >  3 

1  3 

k-  y> 

o 

3  0  O 

O  3 

1  Q 

< 

< 

>  > 

>  > 

1 

</j  3 

>  >  I  >  I 

>  X  X  > 

1  > 

*—  XJ-/> 

X 

3  3  X  3  X 

3  X  X  3 

1  3 

<r  x  o 

< 

3  0  3  0  3 

0  3  3  0 

1  O 

JOI 

*-  *-  3  >-  3 

>  J  3^- 

1  *- 

X  X. 
lu  vn 

* 

*  *"* 

t 

1 

t 

•X  X  - 
—  3  ^ 
3  a. 

3 

4J  n» 

x  i 

< 

> 

-J 

x 


J 

■3 


X  r>»  -*  >r  O  'M  f\J  O  <M  'M 

J  NOf'-D-^mNNN 

--  <J»  <J»  -#•  «  ^  O  -f 

«•••••••• 


at 

< 

3 

3 

'/I 

I 

X 


at  3 
o  o 
3  3 
C  X 
3 


r^  >4  ^  r^  n  o  ^ 

m  »  ^  ^  o  -o  (7*  •r..J> 

o  -•  -r  -<  -r  t*  o  -*  o 

O  3«fNNN^-T'- 
”0  0  O  ^  ^  O  O 

7»  >  -«  -4  ^1  -*  M  <N 

n  r>.  a  d  jj  j»  0> 

•  •••••••• 

ooooooooo 


X  at 
'<  XI 
XJ  3 
,>  < 


n 


X  X 

ii 


3  3 
p  3 


O 

3  o 
at  3  o 

OJ  ^  JJ 

j  o  x 

<  JUJ 

<  3 

X  < 

<  X 

JJ  <t  X 

>  3  < 
>  XI 

LU  > 

3  -M 
O  >  3 

<  X  3 

>  X  O 
3  < 

NQ  > 

> 

I  >  > 
XXX 
3  X  X 
0  3  3 
O  O 


>  >  X  >  > 
3  3X33 
3  3  3  0  3 

U  -  o  —  ►- 


^  ^  O  O 
O  M  M  N  O 
^  3N-0 
jO  -n  <M  M  O 
rsj  O  t  O 
^  ^  O 

•  •  •  •  • 
ro  p+  O  O 


1  -j»  n*  o  <*^  O 
>  ^  ^  *M 

j— «  ^  -<*  O  *- 

N  M  -t  -<  O 

jo  ^  O  3  3 

y>  -*  *r  3*  -* 

[«*  *n  «M  (M 

ao  JO  3»  3*  3* 

•  •  •  •  • 

looooo 


</\  ^  i>  \f\  r\ 


24 


Step  4  -  First  part  of  the  ALERT  model  run  -  Step  B. 


As  we  stated  in  step  3,  the  first  part  of  the  ALERT  model  run  is  to 
select  the  last  POS  BES  value  before  the  POM  outyears.  Step  B 
computes  all  the  regression  equations  for  all  the  models  we 
selected  in  step  3.  This  creates  a  •'library*'  of  possible 
regression  equations  to  model  from  which  to  select  the  POS  BES 
value. 

Fetch  the  ALERT  model,  RLA. ALERT1B,  to  your  AWS  computer  space. 
Your  computer  screen  should  appear  as  follows: 


>  AWS (RLA. ALERT1B)  SCRL  FULL  COLS  00001  00072  PAU(  .SYNON) 

> 

< _ + _ 1 _ +  ....2 _ + _ 3 _ + _ 4 _ + _ 5 _ + _ 6... 

000100  //PPB5RLA2  JOB  ( 00000 ,  LCA)  BIN84  LUCAS  75249  '  , 

000200  //  CLASS=A,MSGCLASS=X, N0TIFY=R0S1RLA 

000300  //STATS  EXEC  PROC-SAS , W0RK= • 50 , 10 ' 

000400  / / ALERTDB  DD  DSN=PPB5GRP. ALERT .JUN88 , DISP=SHR 

000500  //SYSPRINT  DD  SYS0UT=* 

000600 


000700 

/****************************************/ 

000800 

/* 

*/ 

000900 

/* 

FIRST  ALERT  PROGRAM 

*/ 

000000 

/* 

STEP  B 

*/ 

001100 

/* 

(ALERT1B) 

*/ 

001200 

/* 

*/ 

001300 

/****************************************/ 

+ 


You  will  need  to  update  the  bold  characters  as  you  did  in  step  2 . 

The  main  SAS  procedure  executed  for  each  weapon  system  is  as 
follows: 


PROC  REG; 

ID  YEAR; 

MODEL  POSBES  =  TBUY  DUMMY  DUMMY 2  VALUE  YEAR  AGEREC 
/PR  CLI  CLM  DW; 


The  third  line  is  the  one  you  will  vary  for  each  model.  Further 
modifications  may  be  necessary  as  you  incorporate  the  different 
ALERT  models  you  selected  in  the  last  step  into  this  ALERT  program. 
You  may  need  to  add  or  delete  PROC  REGs  as  necessary. 
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When  you  have  completed  making  changes,  submit  this  program  to  the 
job  stream  and  output  it  as  you  did  in  step  2.  An  example  of  the 
output  for  the  A-7  aircraft  is  included  on  the  next  two  pages. 

There  are  five  criteria  from  which  you  can  decide  which  is  the 
optimum  model  to  use  to  select  the  last  POS  BES  value  before  the 
POM  outyears.  They  are:  the  adjusted  R-square  value,  the  F 
statistic,  the  residual  pattern,  the  Durbin-Watson  statistic,  and 
subjective  judgement.  The  R-square  statistic  was  described  in  step 
3.  The  F  value  (denoted  by  ' F  VALUE'  on  the  SAS  output)  ought  to 
be  such  that  the  probality  (denoted  by  'PROB>F'  on  the  SAS  output) 
of  exceeding  it  is  very  small.  The  residual  pattern  (the 
difference  between  the  predicted  and  actual  value)  ought  to  be 
small  also.  The  Durbin-Watson  statistic  measures  autocorrelation 
and  generally  should  approach  the  value  of  2  (see  reference  [6]  for 
more  detail) .  If  the  other  tests  are  reasonable,  subjective 
judgement  plays  heavily  in  the  decision  making  as  knowledge  of 
future  trends  and  circumstances  not  reflected  in  historical  data 
will  determine  which  model  is  the  best  to  use.  In  the  A-7  example, 
the  $9.35  million  was  the  predicted  value  used  for  the  last  POS  BES 
value  before  the  FY92  to  FY97  POM  outyears. 
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Step  S  -  First  part  of  the  ALERT  model  run  -  Step  C. 


For  those  weapon  systems  that  you  may  need  to  make  additional 
program  runs  on,  an  individual  weapon  system  program  the  same  as 
the  RLA. ALERT IB  is  provided.  Simply  follow  the  same  steps  as 
provided  for  in  step  4  above.  The  program's  name  is  RLA. ALERT1C. 

Step  6  -  Second  part  of  the  ALERT  model  run  -  Step  A. 

The  purpose  for  the  second  part  of  the  ALERT  model  run  is  to  select 
the  projection  for  the  BP15  POM  outyears.  Step  A  computes  all  the 
possible  R-square  values  for  all  combinations  of  the  regression 
variables.  From  these  you  will  select  a  "library"  of  possible 
regression  equations  to  model  the  BP15  POM  outyear  projections  in 
step  7.  The  main  SAS  procedure  executed  for  each  weapon  system  is 
as  follows: 


PROC  RSQUARE  CP; 

MODEL  POSBES  =  DUMMY  DUMMY 2  VALUE  YEAR  AGEREC; 


Fetch  the  ALERT  model,  RLA. ALERT2A,  to  your  AWS  computer  space. 
Your  computer  screen  should  appear  as  follows: 


> 

>  AWS (RLA. ALERT2A)  SCRL  FULL  COLS  00001  00072  PAU (  .SYNON) 

> 

<...  + _ 1.  .  ..  +  ...  .2. + _ 3 _ + _ 4 - +  ....5....  + - 6....  +  . 

000100  //PPB5RLA2  JOB  ( 00000 ,  LCA)  BIN84  LUCAS  75249', 

000200  //  CLASS=A,MSGCLASS=X,N0TIFY=R0S1RLA 

000300  //STATS  EXEC  SAS , WORK= ' 50 , 10 ' 

000400  //ALERTDB  DD  DSN=PPB5GRP. ALERT . JUN88 , DISP=SHR 
000500  //SYSPRINT  DD  SYSOUT=* 

000600 


000700 

/****************************************/ 

000800 

/* 

*/ 

000900 

/* 

SECOND  ALERT  PROGRAM 

*/ 

000000 

/* 

STEP  A 

*/ 

001100 

/* 

(ALERT2A) 

*/ 

001200 

/* 

*/ 

001300 

/****************************************/ 

You  will  need  to  update  the  bold  characters  as  you  did  in  step  3. 
No  further  modifications  are  necessary  unless  you  are  adding  or 
deleting  weapon  systems  from  the  ALERT  model  runs. 

Submit  this  program  to  the  job  stream  as  you  did  in  step  3. 
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On  the  following  page  is  the  output  for  RLA.ALERT2A,  Step  A  for 
FY88 .  As  is  step  3,  your  objective  is  to  select  the  models  that 
have  a  high  R-sguare  and  a  low  C(P)  value.  (If  you  remember  what 
you  did  in  step  3,  you  can  skip  the  rest  of  this  step.)  For  each 
type  of  model  (i.e.,  one  variable,  two  variables,  three  variables, 
etc.),  there  appears  to  be  a  natural  break  where  the  R-square  and 
C ( P)  values  suddenly  change  and  get  worse.  These  natural  breaks 
are  indicated  by  the  straight  lines  that  we've  drawn.  Those  models 
below  the  lines  are  candidates  for  input  in  Step  B  (Step  7)  .  We 
further  narrowed  the  possible  models  to  those  indicated  by  the 
asterisks  (*)  .  Since  the  A-7  data  base  has  nothing  but  zeros  for 
the  DUMMY 2  variable,  this  variable  is  meaningless  in  the  regression 
equations.  Therefore,  we  eliminated  all  models  that  have  this 
variable  in  it.  Also,  no  regression  equations  can  be  dependent  on 
the  variables  DUMMY  and  DUMMY 2  alone.  Therefore,  we  eliminated  all 
such  type  models.  The  asterisked  models  are  the  ones  that  become 
the  input  to  the  next  step. 


Step  7  -  Second  part  of  the  ALERT  model  run  -  Step  B. 

As  we  stated  in  step  6,  the  second  part  of  the  ALERT  model  run  is 
to  select  the  projection  for  the  BP15  POM  outyears.  Step  B 
computes  all  the  regression  equations  for  all  the  models  we 
selected  in  step  6.  This  creates  a  "library"  of  possible 
regression  equations  to  model  the  BP15  POM  outyears. 

Fetch  the  ALERT  model,  RLA.ALERT2B,  to  your  AWS  computer  space. 
Your  computer  screen  should  appear  as  follows: 


>  AWS (RLA. ALERT2B)  SCRL  FULL  COLS  00001  00072  PAU (  .SYNON) 

> 

< _ + _ 1 _ + _ 2 _ + _ 3 _ + - 4 - + _ 5 - + _ 6 - +  . 

000100  //PPB5RLA2  JOB  ( 00000 ,  LCA)  ,'  BIN84  LUCAS  75249', 

000200  //  CLASS=A,MSGCLASS=X,N0TIFY=R0S1RLA 

000300  //STATS  EXEC  PR0C=SAS , W0RK= ' 50 , 10 ' 

000400  //ALERTDB  DD  DSN=PPB5GRP . ALERT . JUN88 , DISP=SHR 
000500  //SYSPRINT  DD  SYS0UT=* 

000600 


000700 

000800 

/*************************************** 

/* 

*/ 

*/ 

000900 

/* 

FIRST  ALERT  PROGRAM 

*/ 

000000 

/* 

STEP  B 

*/ 

001100 

/* 

(ALERT2B) 

*/ 

001200 

/* 

* 

*/ 

001300 

/*************************************** 

V 

You  will  need  to  update  the  bold  characters  as  you  did  in  step  2. 
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AIR  LOGISTICS  EARLY  REQUIREMENTS  TECHNIQUE  26 

A-7  FORECAST  13! 32  WEDNESDAY,  NOVEMBER  23,  1900 

BP  15  POS 
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0.48559143  59.584886  DUMMY2  VALUE  YEAR  AGEREC 

0781415374  ' 18.971331  DUMMY  0UMMY2 'VALUE  AGEftCi 

0,82448572  17.694926  DUMMY  DUMMY2  VALUE  YEAR 

0.91970003  5.925698  DUMMY  DUMMY2  YEAR  AGEREC 

0.92718903  5.00000*'  *  DUMMY  VALUE  YEAR  AGEREC 


The  main  SAS  procedures  executed  for  each  weapon  system  is  as 
follows: 


PROC  REG  DATA=DBASE; 

ID  YEAR; 

MODEL  POSBES  =  DUMMY  DUMMY 2  VALUE  YEAR  AGEREC 
/PR  CLI  CLM  DW; 

OUTPUT  OUT=ALERT 

P=FCST  L95=L95  U95=U95  R=RESID  COOKD=COOKD; 

PROC  PLOT  DATA=ALERT; 

PLOT  POSBES *YEAR= ' A '  FCST*YEAR= ' F •  U95*YEAR='U'  L95*YEAR= ' L' 
/  OVERLAY  VPOS=32  HPOS=80; 


The  third  line  is  the  one  you  will  vary  for  each  model.  Further 
modifications  may  be  necessary  as  you  incorporate  the  different 
ALERT  models  you  selected  in  the  last  step  into  this  ALERT  program. 
You  may  need  to  add  or  delete  the  PROC  statements  above  as 
necessary. 

When  you  have  completed  making  changes,  submit  this  program  to  the 
job  stream  and  output  it  as  you  did  in  step  2.  An  example  of  the 
output  for  the  A-7  aircraft  is  included  on  the  next  three  pages. 

The  same  five  criteria  you  used  in  step  4  you  will  use  here  to 
decide  which  is  the  optimum  model  for  forecasting  the  POM  outyears. 
They  are,  the  adjusted  R-square  value,  the  F  statistic,  the 
residuals,  the  Durbin-Watson  statistic,  and  subjective  judgement. 
If  the  other  tests  are  reasonable,  subjective  judgement  plays 
heavily  in  the  decision  making  as  knowledge  of  future  trends  and 
circumstances  not  reflected  in  historical  data  will  determine  which 
model  is  the  best  to  use.  MMMCS  should  be  involved  in  this 
decision  making  process  as  they  are  the  end  user  of  the  ALERT  model 
results. 


Step  8  -  Second  part  of  the  ALERT  model  run  -  Step  C. 

For  those  weapon  systems  that  you  may  need  to  make  additional 
program  runs  on,  an  individual  weapon  system  program  the  same  as 
the  RLA. ALERT2B  is  provided.  Simply  follow  the  same  steps  as 
provided  for  in  step  8  above.  The  program's  name  is  RLA. ALERT2C. 
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APPENDIX  A 


System  Management  Codes  (SMC)  used  in  the 
Air  Logistics  Early  Requirements  Technique  (ALERT) 

Forecasting  Model 


This  appendix  lists  the  SMC  codes  used  to  identify  the 
appropriate  weapon  system  funds  within  the  D041  Central  Secondary 
Item  Stratification  (CSIS)  reports  on  the  Requirements  Data  Bank 
(RDB)  computer  system.  These  SMC  codes  are  current  as  of  the  1988 
ALERT  model  forecast  for  the  BP15  POM.  We  present  these  codes  to 
the  BP15  budget  managers  to  review  and  update,  as  necessary,  before 
we  make  the  ALERT  based  forecasts. 
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ALERT  SMC  CODES 


MISSION 

MISSION 

DESIGN 

SMC 

DESIGN 

A- 7 

337A 

COMMON 

A-10 

329A 

329E 

329F 

B— 1 

B01B 

B01E 

661P 

B-52 

101D 

101G 

101H 

101Z 

608P 

615P 

616P 

617P 

635P 

636P 

650P 

652P 

669P 

676P 

677P 

722P 

725P 

731P 

732P 

C-5  410A 

410E 

C-130  400H 

400Z 
632P 

C-135  119Y  E-3 

119Z 

119E  F-4 

119F 

679P 

C-141  476L 

476E 

COMMON  619P 


SMC 

MISSION 

DESIGN 

SMC 

634P 

F-15 

328A 

639P 

328B 

644P 

328C 

645P 

328D 

650C 

328Z 

650P 

640P 

651C 

654P 

651P 

656P 

655P 

672P 

660P 

692P 

665P 

F-16 

687P 

666P 

F16A 

668P 

F16B 

67  IP 

F16C 

674P 

F16D 

678P 

F16Z 

684P 

F-lll 

129A 

695P 

3  24A 

697P 

324D 

705P 

324E 

732P 

324F 

733P 

324L 

9999 

324Z 

999A 

635P 

999B 

637P 

999C 

642P 

999F 

647P 

999H 

657P 

999T 

673P 

999U 

728P. 

999V 

729P 

411Z 

735P 

4  HE 

FlOO 

328E 

327Z 

380A 

638P 

380B 

649P 

380E 

682P 

380N 

685P 

F16N 

730P 
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